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Given  a mean-square  continuous  stochastic  vector  process  y with  stationary  increments 
and  a rational  spectral  density  <t>  such  that  $(«>)  is  finite  and  nonsingular,  consider  the  problem 
of  finding  all  minimal  Gauss-Markov  representations  ( stochastic  realizations)  of  y.  All  such 
realizations  are  characterized  and  classified  with  respect  to  deterministic  as  well  as  probabilistic 
properties.  It  is  shown  that  only  certain  realizations  ( internal  stochastic  realizations ) can  be 
determined  from  the  given  output  process  y.  All  others  (external  stochastic  realizations)  require 
that  the  probability  space  be  extended  with  an  exogeneous  random  component  A complete 
characterization  of  the  sets  of  internal  and  external  stochastic  realizations  is  provided.  It  is  shown 
that  the  state  process  of  any  internal  stochastic  realization  can  be  expressed  in  terms  of  two 
steady-state  Kalman-Bucy  filters,  one  evolving  forward  in  time  over  the  infinite  past  and  one 
backward  over  the  infinite  future.  An  algorithm  is  presented  which  generates  families  of  external 
realizations  defined  on  the  same  probability  space  and  totally  ordered  with  respect  to  state 
covariances. 
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1.  Introduction 

One  of  the  most  common  models  of  random  phenomena  in  control  theory  is  provided  by 
the  linear  stochastic  system 


(1.1a) 

(1.1b) 


dx  ■ Ax  dt  + B dw 
dz  * Cxdt  + Ddw  , 

where  A,  B,  C and  D are  constant  matrices  of  dimensions  nxn,  nxk,  mxn  and  mxk  respectively, 
and  w is  a k -dimensional  mean-square  continuous  stochastic  process  with  zero  mean,  stationary 
orthogonal  increments,  and  w(0)  * 0.  Here  we  shall  assume  that  w is  defined  on  the  whole  real 
line  R,  that  is 


(1.2) 


E (w(t) } = 0 for  all  t€R 
E{w(t)w(s)'}  = V4{|t|  + |s|  — |t  — s|}l 

(35;  p.  511 , where  E{*}  denotes  mathematical  expectation  and  prime  (')  transposition.  (All 
vectors  without  prime  are  column  vectors.)  For  later  reference,  let  denote  the  class  of  all  such 
orthogonal  increment  processes,  the  index  referring  to  the  dimension;  more  generally  we  shall  say 
that  the  process  is  of  class  W.  Moreover,  we  assume  that  A is  a stability  matrix,  i.e.  all  the  eigen- 
values of  A are  situated  in  the  left  complex  half-plane;  we  shall  write  Re{X(A)}<0  for  short. 

This  assumption  will  insure  that  (1.1a)  has  the  unique  solution 

t 

x(t)  * / e^t— T^Bdw(r)  (1-3) 

on  the  real  line,  where  the  integral  is  defined  in  quadratic  mean.  This  is  an  n-dimensional  vector 
process.  If,  in  addition,  we  assume  that  z(0)  * 0,  the  m-dimensional  process  z can  be  determined 
uniquely  by  integrating  (1.1b).  We  shall  call  x the  state  process,  w the  input  process  and  z the 
output  process.  Clearly  the  state  process  x is  (wide  sense)  stationary,  i.e.  the  state  covariance 
matrix 


P * E (x(t)x(t)'} 

does  not  depend  on  t,  and  it  satisfies  the  Liapunov  equation 

AP  + PA'  + BB'  «=  0 . 

(Seee.g.  [35].)  The  output  process  z has  stationary  increments. 
Each  w € Wk  has  a unique  spectral  representation 

~~  iwt 


(1.4) 


(1.5) 


c Section 

Section 
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w(t) 
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[12;  p.  205] , where  dw  is  an  orthogonal  stochastic  measure  such  that  E (dw(co)dw(cj)^ } - Idw. 
(Here  t denotes  complex  conjugation  and  transposition.)  Then  (1.3)  may  be  written 

OO 


x(t)-  f eiwt(iwl- A)“1Bdw(cj)  . 

— OO 

(Indeed,  making  the  substitution  (si  - A)- ^ * — [I  + A(sl  — A)-1  ] , 

s 

Inserting  (1.7a)  into  (1.1b)  and  integrating  yields 


z(t) 


■/ 


ICO 


W(ico)dw(w)  , 


(1.7a) 

(1.7a)  is  seen  to  satisfy  (1.1a).) 

(1.7b) 


where 


W(s)«C(sI-  AHB  + D . 


(1.8) 


Weshallcall  W the  transfer  function  of  (1.1).  Relation  (1.7b)  is  a spectral  representation  of  z; 
dz(co) : = W(ico)dw(co)  being  an  orthogonal  stochastic  measure  such  that 

E{dz(co)dz(co)t}  = 4>(ioo)dco  , (1.9) 


where  <t>  is  the  spectral  density  given  by 

4*(s)  = W(s)W( — s)'  . (1.10) 

This  is  an  mxm-matrix  of  rational  functions  such  that  (i)  each  element  of  4>  is  analytic  on  the 
imaginary  axis,  (ii)  4>  is  parahermitian,  i.e.  4>(— s)  * 4>(s)',  (iii)  4>(ico)  is  nonnegative  definite 
Hermitian  for  all  real  co,  and  (iv)  $(<»)<«>,  Such  a $ is  called  a spectral  function  [3, 4] . 

In  this  paper  we  consider  the  following  inverse  problem.  Let  {y(t);tGR}  be  a given  mean- 
square  continuous  and  purely  nondeterministic  m-dimensional  stochastic  process  with  zero  mean, 
stationary  increments  and  y(0)  - 0.  Then  there  is  a spectral  representation 


[12;  p.  205] , where  dy  is  an  orthogonal  stochastic  measure  such  that  [9] 

E{dy(w)dy(w)t)  « <J>(iw)dw  . (1.12) 

Here  4>  is  an  mxm-matrix  of  real  rational  functions  satisfying  conditions  (i) — (iv)  above.  Setting 
R :■  4>(<x>),  we  also  assume  that  (v)  R—1  exists  and  that  (vi)  4>(iu>)  is  positive  definite  for  all  real 
u>.  The  problem  is  to  find  representations  (1.1)  such  that  the  output  process  z is  equivalent  to  the 
given  process  y in  some  sense  to  be  specified  below.  Such  a representation  will  be  called  a stochastic 
realization. 

More  precisely,  the  system  ( 1 . 1 ) will  be  called  a wide  sense  stochastic  realization  of  y if  z 


3 


has  the  same  spectral  density  4»  as  y and  a proper  stochastic  realization  if,  for  each  t € (-*«,«»), 
i(t)  - y(t)  a.s.  (In  the  sequel  we  shall  leave  out  the  **a.s.",  hence  regarding  such  equivalent  processes 
as  equal.)  Clearly  each  proper  stochastic  realization  is  also  a wide  sense  stochastic  realization,  but 
the  converse  is  not  true. 

The  stochastic  realization  problem  is  related  to  the  spectral  factorization  problem:  Given  a 
rational  spectral  function  ♦,  find  all  matrices  W(s)  of  real  rational  functions  with  all  its  poles  in 
Re(s)  < 0 and  satisfying  (1.10).  Such  a function  will  be  called  a stable  spectral  factor.  Let  b {• } 
denote  McMillan  degree  [8] . Then  b {W}  > V»b  {♦ } ; if  there  is  equality  we  shall  say  that  W is 
minimal.  Via  have  seen  that  the  transfer  function  (1.S)  of  any  wide  sense  stochastic  realization  of 
y is  a stable  spectral  factor  of  the  spectral  density  of  y.  Conversely  any  such  spectral  factor  W is 
the  transfer  function  of  an  equivalence  class  of  wide  sense  stochastic  realizations.  In  fact,  for  any 
orthogonal  stochastic  measure  dw  such  that  E (dw(u>)dw(u>)*  ) * ldu>,  the  process 


W(ico)dw(ui) 


(1.13) 


has  the  same  spectral  density  as  y.  Since  W is  a real  rational  matrix  function  analytic  in  Re(s)  > 0, 
there  is  a quadruplet  [A,B,C,D]  of  matrices  such  that  (1.8)  holds  (8) , with  A a stability  matrix. 
Now  let  x be  defined  by  (1.7a)  and  w by  (1.6).  Then  w is  of  class  W and  (x,z)  satisfy  (1.1) 
as  asserted.  Note  that  [A,B,C,D]  defines  one  wide  sense  stochastic  realization  for  each  w€Wk. 
Since  these  realizations  are  equivalent  upto  second-order  properties  of  z,  in  the  sequel  we  shall  say 
that  [A,B,C,D]  is  a wide  sense  stochastic  realization,  thereby  referring  to  the  whole  equivalence 
class.  To  avoid  trivialities  we  shall  assume  that  the  representation  (1.8)  is  chosen  so  that  the 
dimension  of  the  matrix  A equals  6(W),  i.e.  we  shall  only  consider  quadruplets  (A,B,C,D]  for 
which  (A,B)  is  controllable  and  (A,C)  is  observable  [8) . We  shall  call  a stochastic  realization 
minimal  if  it  corresponds  to  a minimal  spectral  factor.  Hence,  the  minimal  stochastic  realizations 
are  precisely  those  representations  (1.1)  which  have  a state  process  of  smallest  possible  dimension, 
i.e.  n • V46(«t>).  In  this  paper  we  shall  restrict  our  attention  to  such  realizations,  the  basic  problem 
being  to  find  all  of  them. 


Determining  all  wide  sense  minimal  stochastic  realizations  [A,B,C,D]  is  a deterministic  problem 
which  has  been  studied  extensively  by,  among  others,  8.  D.  0.  Anderson  [5] , Faurre  [11]  and 
J.  C.  Willems  [32] , the  first  of  whom  has  named  it  the  inverse  problem  of  covariance  generation. 

To  facilitate  its  solution  we  note  that  the  spectral  density  of  y can  be  written 

<Ms)-Z(t)  + Z(— s)\  (1.14) 
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where  Z is  positive  real1  and  rational,  and  6(Z)  - n [3,4,11,32].  Let 

Z(s)-H(sl-F)-1G  + %R  (1.15) 

be  a minimal  realization  [8]  of  Z,  i.e.  F,G  and  H are  constant  matrices  of  dimensions  nxn, 
nxm  and  mxn  respectively.  Hence  F is  a stability  matrix,  (F,G)  is  controllable  and  (H,F)  is 
observable  [8].  There  are  computational  procedures  for  determining  (F,G,H,R)  from  4> 

[8,  13,  31,  38] , so  in  the  sequel  we  shall  assume  that  such  a quadruplet  is  given. 

It  can  be  shown  [5]  that  all  wide  sense  minimal  stochastic  realizations  are  given  by 

[A.B.C.D]  - [TFT-1,  T(BltB2)S,  HT"1,  (R%.0)S]  (1.16) 

where  the  nonsingular  matrix  T and  the  orthogonal  matrix  S are  arbitrary,  R''*  is  the  symmetric 
square-root  of  R,  and  (B^^)  are  two  matrices,  nxm  and  nxp  respectively  (p  is  arbitrary),  such 
that  (P,B'j,B2)  satisfy  the  conditions 

FP  + PF'  + B i B'i  + BjB-j  * 0 (1.17a) 

PH'  + BjR^-G  (1.17b) 

P is  a symmetric,  positive  definite  nxn-matrix  . (1.17c) 

Conversely,  any  [A,B,C,D]  constructed  in  this  fashion  is  a wide  sense  minimal  realization.  It  is 
no  restriction  to  set  T * I and  S * 1 in  (1.16),  i.e.  to  consider  only  realizations  of  the  form 

dx  * Fxdt  + Bj du  + Bjdv  (1.18a) 

dz*Hxdt+R%du  (1.18b) 

where  w-  f^j  G L'm+p.  In  fact,  all  other  stochastic  realizations  can  be  obtained  from  (1.18)  by 
multiplying  (1.18a)  by  an  arbitrary  T and  transforming  w by  an  orthogonal  transformation. 
Consequently  we  shall  be  working  in  a fixed  coordinate  system,  thereby  identifying  each  transfer 
function  (spectral  factor)  W with  one  quadruplet  (F,B,H,(R^,0)] . Hence  the  wide  sense  problem 
is  reduced  to  determining  B ■ (B^.Bj). 

The  main  topic  of  this  paper  is  the  characterization  of  all  proper  minimal  stochastic  realizations. 
This  is  a probabilistic  problem.  In  addition  to  the  input-output  map  of  (1.1)  we  need  to  determine 
the  input  process  w,  which  is  no  longer  arbitrary;  hence  we  shall  be  looking  for  quintuplets 
[A,B,C,D,”w] . For  an  arbitrary  representation  (1.1),  let  (i7,F,P)  be  a probability  space  on  which 

^A  real  rational  function  Z without  poles  on  the  imaginary  axis  is  said  to  b e positive  reel  if  it  has 
no  poles  in  Refs]  > 0 and  Z(icu)  + Z(— ia>)'  is  nonnegative  definite  Hermitian  for  all  real  cj. 
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both  y and  w are  defined,  and  define  H(y)  and  H(w)  to  be  the  closed  linear  hulls  in  LjlO.F.P) 

of  {Vj(t);  t G (-«*,«»).  i ■ 1,2 m}  and  {Wj( t) ; t €(-«*>, «»),  i - 1,2 k)  respectively.  Since 

y is  given,  H(y)  is  fixed,  whereas  H(w)  varies  with  different  choices  of  representation  (1.1).  For 
a proper  stochastic  realization  we  will  always  have  H(y)  C H(w).  We  shall  say  that  [A,B,C,D;  w) 
is  an  internal  stochastic  realization  if  H (y)  ■ H(w)  and  an  external  stochastic  realization  if 
H(y)  # H(w),  adding  the  attribute  minimal  as  appropriate.  Hence  the  internal  realizations  are  precisely 
those  proper  stochastic  realizations  which  can  be  constructed  in  terms  of  the  given  process  y.  whereas 
the  external  realizations  require  extending  our  probabilistic  setting  with  an  exogeneous  noise 
generator  unrelated  to  y.  Various  aspects  of  the  proper  stochastic  realization  problem  have  been 
studied  by  Akaike  (1,  2] , Picci  (23,  24)  and  Rozanov  [26] , but  here  we  shall  give  a complete 
characterization  of  all  such  realizations.  (In  [21]  we  give  an  alternative  presentation  of  these  results 
in  terms  of  minimal  splitting  subspaces .)  After  submitting  this  paper  we  have  learned  about  a series 
of  as  yet  unpublished  papers  by  Ruckebusch  [27-29]  containing  discrete-time  counterparts  of  some 
of  the  results  presented  here;  these  papers  provide  an  alternative  approach  to  the  problem. 

The  outline  of  the  paper  goes  as  follows.  Section  2 is  devoted  to  preliminaries  and  definitions. 

In  Section  3 we  show  that  to  each  proper  stochastic  realization  there  is  a representation  (1.1)  with 
Re  (X(A) } > 0 and  z = y,  the  dynamic  relations  of  which  evolve  backward  in  time.  These  repre- 
sentations, which  are  an  important  tool  in  our  subsequent  analysis,  are  called  proper  backward 
stochastic  realizations.  In  Sections  4 and  5 the  internal  stochastic  realizations  are  constructed  and 
classified,  and  it  is  shown  that  these  are  precisely  the  proper  stochastic  realizations  for  which  02  = 0. 
Each  internal  state  process  can  be  expressed  in  terms  of  two  steady-state  Kalman-Bucy  estimates, 
one  filter  evolving  in  the  forward  direction  from  time  t * — «>  and  the  other  in  the  backward  direction 
from  t * 00 . Sections  6 and  7 are  devoted  to  external  stochastic  realizations.  First,  in  Section  6, 
we  construct  a system  of  differential  equations  in  B-j  and  B2  which  generates  families  of  wide 
sense  stochastic  realizations,  totally  ordered  with  respect  to  state  covariances.  In  Section  7 this  result 
is  interpreted  in  terms  of  proper  stochastic  realizations  and  a complete  characterization  of  all  such 
realizations  is  provided. 

This  paper  extends  the  results  reported  (without  proofs)  in  our  short  note  [20] . 

2.  Preliminaries  and  definitions 

Let  the  function  A : Rnxn  -*  Rnxn  be  given  by 

A{P)  - FP  + PF'  + (G  — PH')R_1(G  - PH')'  , 


■A. 


(2.1) 


i r~ 


and  define  the  set  P*  {P  | P'  a P;  A(P)  < 0}  of  symmetric  nxn-matrices,  where  Q>0  (Q  > 0) 
means  that  Q is  nonnegative  (positive)  definite.  Also  introduce  the  subset  Pg  = {P  G P | A(P)  = 0} . 

In  the  following  theorem  we  collect  some  facts  from  Anderson  (5) , Faurre  [11]  and 
Willems  [32]. 

Theorem  2.1.  The  set  P is  dosed,  bounded  and  convex,  and  there  are  rwo  elements  P.  and  P* 
in  Pg  such  that 

P.  < P < P*  for  all  Pep  . (2.2) 

Moreover,  P is  the  set  of  all  solutions  P of  (1.17),  and  Pg  is  the  set  of  all  such  solutions  for  which 
B2*  0. 

Each  PGP  can  be  interpreted  as  the  covariance  matrix  (1.4)  of  the  corresponding  stochastic 
realization  (1.18).  Consequently,  there  is  a minimum  variance  (P.)  and  a maximum-variance  (P*) 
wide  sense  stochastic  realization,  and  for  these  realizations  we  have  B2  = 0. 


For  each  PGP,  define  the  feedback  matrix 


p=  F-(G-PH')R-1H  , (2.3) 

the  significance  of  which  will  be  made  clear  below.  Let  the  feedback  matrices  corresponding  to 
P.  and  P*  be  denoted  T.  and  T*  respectively.  It  can  be  shown  that  Re{X(r»)}<0  and 
R{X(r*)}  >0  [32,  p.  360;  11,  p.  53].  Consequently,  for  each  matrix  N,  the  Liapunov  equation 

r.M  + MT.  + H'R-1H  + N = 0 (2.4) 

has  a unique  solution  M.(N),  which  is  positive  definite  whenever  N is  nonnegative  definite. 

In  fact,  since  (F,H)  is  controllable,  so  is  (T.H).  (See  e.g.  [36] .)  Likewise 

— r*'M  — MT*  + H'R—^H  + N = 0 (2.5) 

has  a unique  positive  definite  solution  M#(N)  for  each  N > 0.  Furthermore,  define  P+  * 

(PGP  I P > P,  } and  P_~  {P  G P | P < P*  } . Since  4>(iu))  > 0 for  all  real  w.  P.  < P*  [32,  p.  360] , 
and  consequently  P+  and  P_  are  nonempty. 

Theorem  2.2.  Let  n and  n be  the  unique  solutions  of  the  nxn-matrix  differential  equations 

net)  - A(n(t>);  n(0)  - o (2.6) 


n(t)  - A(fi(t));  11(0) -o 


respectively , where  A is  given  by  (2.1)  and  A by 
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A(P)  - F'P  + PF  + (H*  - PG)R-1(H'  - PG)*  . (2.8) 

Then  H(t)  -*  P.  and  TT(t)  -*  (P*)”1  as  t -*  <® . Moreover,  the  matrix  P • P.  + (MJN))  -1 
belongs  to  P+  if  and  only  if  N > 0.  Likewise,  P ■ P*  — (M*(N))  belongs  to  P_  if  and  only  if 
N > 0.  Finally.  P*  - P.  • (M.(0))  _1  • [M‘(0M 

Various  versions  of  this  theorem  can  be  found  in  (7)  and  (11).  )t  provides  us  with  a procedure 
to  determine  all  elements  in  P+  U P_  : First  compute  P.  and  P*.  Then  varying  N over  the 
nonnegative  cone  will  generate  the  other  elements  in  P+  U P_.  The  corresponding  wide  sense  stochastic 
realizations  [F,B.H,(R^,0))  can  then  be  obtained  by  determining  from 

i-H 


B,  - (G  - PH')R‘ 
B28^--A(P)  , 


(2.9a) 

(2.9b) 


which  is  merely  (1.17)  reformulated. 

In  Section  6 another  method  for  generating  wide  sense  stochastic  realizations  is  presented,  which 
is  formulated  directly  in  terms  of  B,  the  unknown  quantity  in  (F,B,H',(R^.O)] . Hence  the 
intermediate  step  of  determining  P will  be  eliminated.  Define  6 to  be  the  set  of  all  B*(Bi,B2) 
given  by  (2.9)  as  P ranges  over  P.  Let  Bp.  S+  and  B_  be  defined  analogously  in  terms  of  P0.  P+ 
and  P_.  The  set  Bq  consists  of  all  B€B  with  B2"0  (Theorem  2.1).  In  particular,  let  B„  and 
B*  be  the  unique  elements  in  Bq  corresponding  to  P,  and  P*  respectively. 

All  stochastic  processes  in  this  paper  will  have  finite  second  order  moments.  Given  a k-dimensional 
vector  process  tj  of  this  type,  defined  on  some  probability  space  (ft, F,P),  and  a subset  1 of 
(-aow),  let  Hj(tj)  be  the  closed  linear  hull  in  L2(ft.F.P)  of  the  stochastic  variables  {q|(t);t€l, 

i-1,2 k).  (Wewrite  Ht(rj)  iftheset  l contains  only  the  point  t.)  If  £ is  an  C-dimensionat 

stochastic  vector  such  that  £j  € H|(tj),  i - 1,2 C,  we  shall  misuse  notations  slightly  by  writing 

£ € Hj(rj).  For  ? € L2(^. F,P),  let  E{?|Hj(t?)}  be  the  projection  of  ? onto  H,(t}),  i.e.  the  wide 

A 

sense  conditional  mean  in  the  terminology  of  Doob  [10) . (We  shall  sometimes  write  E {£  | r?(t) ) 
instead  of  E {?  I Ht(q) }.)  For  simplicity  let  H(n),  H~(tj)  and  H*(tj)  denote  H^_ooooj(q), 

H(_-ct|(r|)  and  M 00)(T?)  respectively.  Moreover,  set  ijt(r)  ■ q(t  + r)  - t?(t),  and  define  (dr?) 
and  H*(drj)  to  be  respectively  HQ(qt)  and  Hq^).  Note  that  if  r?(0)  ■ 0 (which  is  often  the  case 
with  the  processes  studied  in  this  paper),  we  have  H^drj)  • H(rj). 

As  mentioned  in  Section  1 , any  mean-square  continuous  stochastic  vector  process  (rj(t) ; t € R 1 
with  stationary  increments  and  q(0)  ■ 0 has  a representation  of  the  form 

T Jwt  . 

rj(t)  - / — ■ — - dr?(u>) 

J lu> 


(2.10) 


1 
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[ 1 2;  p.  205] , where  drj  it  an  orthogonal  stochastic  measure,  called  the  stochastic  spectral  measure 
of  t).  If,  in  addition,  tj  is  purely  nondeterministic,  it  has  an  absolutely  continuous  spectral 
distribution  [9] , i.e. 


EittfMdrjM1}  ■ S(ico)du> 


(2.11) 


where  S is  the  spectral  density  of  t?.  If  E{rj(t)}  -0  for  all  t and  S"l  (identity),  rj  is  said  to 
be  of  class  W.  The  spectral  decomposition  (2.10)  defines  an  isometric  correspondence  between  H(rj) 


and  L2(R,S(icj)dw)  under  which  t?(t)  corresponds  to  (e,u,t-1)/iu>;  hence  to  any  real  random 


variable  £ € H(tj)  there  corresponds  an  (essentially)  unique  g€  L2(R,S(iu>)du>)  such  that 

OO 

f g(w)dr/(iu))  . 


In  fact,  the  system  of  functions  {(e*4*>t — 1)/icj;  t€R}  is  complete  in  L2(R,S(ito)dto)  (12;  p.  204). 
Hence  we  have  the  following  lemma  which  we  shall  need  below. 


Lemma  2.3.  Let  f and  rj  be  mean-square  continuous  and  purely  nondeterministic  stochastic  vector 
processes,  defined  on  the  whole  real  line  R,  with  (jointly)  stationary  increments  and  such  that 


£(t)€H(tj)  for  all  t€R.  Let  S(iuj)  be  the  spectral  density  of  rj , and  assume  that  {(0)  * 0.  Then 


there  is  a matrix-valued  function  K such  that 


.loot 


-1 


ICO 


K(ico)  € L2(R,S(iu»)dco)  for  all  t€R  and 


such  that 


— - K(ico)dr?(co)  . 

If,  in  addition,  { and  v are  both  of  class  U1 , 

K(s)K(— s)'“  i . 


(2.12) 


(2.13) 


The  last  statement  follows  from  d{  ■ K(ico)dr)  and  the  fact  that  both  £ and  tj  have  identity 
spectral  densities. 


3.  Forward  and  backward  stochastic  realizations 

Let  (x(t);  t € R } be  an  n-dimensional  wide  sense  Markov  process,  i.e. 


I (x(s)  I Hf  (x) } - E (x(s)  | x(t) } for  s>t, 


(3.1) 


or  equivalently 


E (x(s)  | H*(x) } * E (x(s)  | x(t) } for  s<t 


(3.2) 


In  addition,  assume  that  x is  purely  nondeterministic  and  (wide  sense)  stationary.  It  is  well-known 
[11]  that  such  a process  can  be  described  as  the  solution  of  a system  of  linear  stochastic  differential 


I 
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equations  of  the  type 


dx  - Axdt  + Bdw  , 


(3.3) 


where  A and  B are  constant  matrices,  Re{A(A) } < 0,  and  w is  a vector  process  of  class  U/  such 
that^  H*  (dw)  1 M(  (x)  for  all  t€R.  [In  fact,  A being  a stability  matrix  implies  that  (3.3)  has  the 
solution  (1.3),  and  consequently  (x)  C (dw)  i H^ldw).]  Moreover,  the  covariance  matrix 
P E {x( t)x(t)' > satisfies  (1.5).  The  model  (3.3)  is  clearly  unsymmetric  with  respect  to  time,  x(t) 
being  orthogonal  to  future  increments  of  w,  but  not  to  past  ones.  Hence  we  shall  call  (3.3)  the 
forward  representation  of  x. 

We  shall  now  show  that  x has  a backward  representation  also,  i.e.  a model  (3.3)  with 
Re{\(A)}>0  and  H~(dw)  i H^(x)  for  all  t€R.  To  this  end  first  observe  that  the  forward 
representation  (3.3)  can  be  integrated  between  t and  s to  yield 

x(s)  - eA(s_t)x(t)  + J eA(s~T)Bdw(r)  . (3.4) 

t 

where  the  two  terms  are  orthogonal  if  and  only  if  s > t;  in  this  case  it  can  be  seen  that  (3.4)  is 
precisely  the  orthogonal  decomposition 

x(s)  = E (x(s)  I H~(x) } + (x(s)  — E {x (s)  I H~(x) }]  . (3.5) 

We  shall  use  a symmetric  argument  to  determine  the  backward  representation.  More  precisely,  for 
s < t we  shall  derive  a backward  version  of  (3.4)  from  the  decomposition 

x(s)-E{x(s)|H*(x)}Mx(s)-E{x(s)iH+(x)}]  . (3.65 

In  view  of  the  Markov  property  (4.2)  and  the  standard  projection  formula  [11]  the  first  term  in 
(3.6)  can  be  written 


E{x(s)  | H*(x)}  = E{x(s)x(t)'}E{x(t)x(t)'}~1x(t) 

- PeA’(t-s)P_1x(t)  ■=  e_PA  P 1(s_t)x(t)  , 


(3.7) 


where  we  have  used  (3.4)  to  evaluate  E (x(s)x(t)'}.  From  (3.7)  it  is  clear  that 

PA'p- It 

{(t)  - eKA  K x(t) 


(3.8) 


is  a wide  sense  backward  martingale  with  respect  to  the  family  {H^  (x) } , i.e. 


E{{(s)  |H*(x)}-$(t)  for  s<t , 


(3.9) 


2"H11H2"  means  "H1  and  H2  are  orthogonal”. 
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and  using  (3.3)  we  obtain 

d{  • ePA  P 1t((AP  + PA')P“1xdt  + Bdw]  , 
which,  because  of  (1.5),  may  be  written 

d{-ePA  P 1lB(dw- B'P-^dt)  . (3.10) 

Lemma  3.1.  Let  (x(t);  t£R)  be  the  solution  on  (— < oo.oo)  of  (3.3) , and  let  P be  the  covariance 
matrix  of  x.  Then  the  vector  process  w,  defined  by 

dw- dw-B'P-’xdt;  w(0)  - 0,  (3.11) 

belongs  to  class  U '.and  H~(dw)  is  orthogonal  to  H*(x)  for  all  t€R. 

Proof.  Inserting  (1.6)  and  (1.7a)  for  w and  x in  (3.11)  yields 

7 Piu)t  1 

w(t)  - | T(iu>)dw(u>)  (3.12) 

J iw 

OO 

where 

T(s)«  I-B'P-^sI- A)_1B  . (3.13) 

Consequently  w is  a zero-mean,  mean-square  continuous  vector  process  with  stationary-  increments 
and  spectral  density  T(s)T(— s)'  and  such  that  w(0)  = 0.  Then,  to  see  that  w is  of  class  W,  it 
just  remains  to  show  that 

T(s)T(— s)'-l  . (3.14) 

To  this  end  first  note  that 

T(s)T(— s)'  - I - B'P-^sI  - A)—1B  - N(s)P_1B  , (3.15) 

where 

N(s)«T(s)B'(-sl-  A')”1  (3.16a) 

« B'(— si  - A')-1  - B'P-^sI  - A)  ^ BB'( — si  - A')-1  . (3.16b) 

In  view  of  (1.5)  we  may  write 

BB'  - (si  - A)P  + P(-sl  - A') 

which  inserted  into  (3.16b)  yields 

I 

■Saet 


N(s)  - -B'P-^sl  - A)-1P  . 


(3.17) 
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",r 


Now  (3.15)  and  (3.17)  together  yield  (3.14).  To  show  that  H~(dw)  1 H*(x),  take  ti  < t2  < t3 
and  form 


w 

■ {[w(t-j)  - w(t2)]x(t3)'}  * J 


ei<*?t1  — eicot2  e_iujt3 


N(ico)du)  . 


(3.18) 


Here  we  have  used  (3.12),  (1.7a)  and  (3.16a)  to  obtain  (3.18).  But  (e— 'u,ot  — e '^J/iw  is  the 
Fourier  transform  of  the  indicator  function  X(a  p ) of  the  interval  ( a ,0)  and,  in  view  of  (3.17), 
N(iw)  is  the  Fourier  transform  of  — B'P~ ^e^'Pxjo  »)•  Hence  Parseval's  Theorem  yields 

OO 

E{lw(.,)  -w(,2>]x(t3n  - B P-’  / x(ti_,3  t2_t3|(t)x(0Hlt)eA,dtP, 

which  is  zero  whenever  t^,  t3  < tg  . ° 

Consequently,  in  view  of  (3.7)— (3.1 1),  (3.6)  can  be  written 

x(s)  = e~PA'P_1(s_t)x(t)  + e_PA'P~1s(f(s)  - £(t)] 

= e_PA'P~1(s_t)x(t)  + J e” PA  P 1(s_T)Bdw(T) , (3.19) 

t 

which  is  the  backward  counterpart  of  (3.4).  Since  Re{X(— PA'P~ ^) } > 0 and  H^  (dw)  I H (x) 
for  all  tER, 


dx  = — PA'P  ^dt  + Bdw  , 


(3.20) 


obtained  by  differentiating  (3.19),  is  a backward  representation  of  x.  In  [22,  30]  it  was  shown 
that,  for  arbitrary  w and  w of  class  W,  the  solutions  on  (— oooo)  of  (3.3)  and  (3.20)  have  the  same 
second-order  properties.  Here  we  have  demonstrated  that,  for  the  particular  choice  (3.1 1)  of  w, 
these  systems  actually  represent  the  same  wide  sense  Markov  process.  We  record  this  observation 
in  the  following  theorem. 

Theorem  3.2.  Let  {x  (t) ; tER)  be  a vector-valued,  wide  sense  stationary,  purely  nondeterministic, 
wide  sense  Markov  process  with  covariance  matrix  P.  Then  x has  a forward  representation  (3.3) 
with  Re{X(A) } < 0 and  H*(dw)  1 H~(x)  for  all  tER,  and  a corresponding  backward  representation 
(3.20)  with  H~(dw)  1 H*(x)  for  all  tER.  The  processes  x,  w and  w are  related  as  in  (3.1 1 ). 

In  Section  1 we  only  considered  stochastic  realizations  for  which  Re{X(A) } < 0,  i.e.  with  the 
state  process  x written  in  the  forward  form.  From  what  has  been  said  above,  it  is  clear  that  we  will 
get  an  isomorphic  theory  by  reversing  time.  In  particular,  let  us  consider  representations  of  the  type 
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dx  ■ ASdt  + Bdw 
dz  ■ Cxdt  + 5dw  , 


(3.21a) 

(3.21b) 


where  Re{X(A)}>0  and  Ht(dw)lH*(x)  for  all  t£R.  We  shall  call  (3.21)  a proper  or  a wide 
sense  backward  stochastic  realization  of  y,  depending  on  whether  the  solution  z of  (3.21)  on 
(_oooo)  equals  y or  has  the  same  spectral  density  as  y.  Equation  (3.21a)  has  the  unique  solution 


x(t) 


-/ 


_A(t— t)q  ATT. 


Bdw(r) 


(3.22) 


on  (— ' *>,°°),  and  by  the  procedure  used  in  Section  1 we  obtain 


?(t) 


•/ 


JiA>t  4 _ * 

- — W(ia))dw(u) 

iw 


where 


W(s)-C(sI-A)_1B+B  . 

If  (3.21)  is  a backward  stochastic  realization  of  y,  we  must  have 

W(s)W(— s)'  - <|>(s)  , 


(3.23) 


(3.24) 


(3.25) 


i.e.  W is  a strictly  unstable  spectral  factor  of  4>.  Conversely,  each  such  spectral  factor  W is  the 
transfer  function  of  an  equivalence  class  of  wide  sense  backward  stochastic  realizations;  to  see  this 
proceed  as  in  Section  1.  If  W is  minimal,  we  shall  say  that  the  realization  (3.21)  is  minimal;  only 
such  representations  will  be  considered  in  the  sequel. 

Consider  the  problem  of  determining  all  strictly  unstable  minimal  spectral  factors  (3.24)  of 
<j>.  Since  W(-s)W(s)'  - 4»(s)’,  this  problem  is  equivalent  to  finding  all  stable  minimal  factors  W(-s) 
of  4>(s)'.  Given  the  representation  (1.14)— (1.15),  we  have 


4>(s)'  «2(s)  +?(-$)', 

where  2 is  the  positive  real  matrix  function  Z',  i.e. 

2(s)-G'(sI-F'r1H'  + %R  . 


(3.26) 


(3.27) 


Consequently  we  have  reduced  the  problem  to  the  one  considered  in  Section  1.  In  fact,  all  stable 
factors 


W(-s)-C(sl  + A)“1(-B)+'5 


(3.28) 


of  4»(s)'  are  given  by 
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[-A-B.e.C]  - [TFT-1,T(-B1.-B2)S,GT-1.(RV4.0)S]  (3.29) 

where  T is  any  nonsingular  nxn-matrix,  S is  any  orthogonal  matrix  of  appropriate  dimension 
and  (B1f62)  satisfy 

F'P  + PF  + B,!',  +B2B2-0  (3.30a) 

PG-B^-H'  (3.30b) 

P is  a symmetric,  positive  definite  nx  n-matrix.  (3.30c) 

This  the  dual  spectra!  factorization  problem  considered  by  Anderson  |6)  and  Faurre  [11].  As  in 
the  forward  setting  it  is  no  restriction  to  take  T - 1 and  S • 1,  i.e.  to  consider  backward  stochastic 
realizations  of  the  form  [— F*.  (B1,B2),G\(R',,0)]  only;  then  P in  (3.30)  is  the  state  covariance 
matrix. 

Let  A be  given  by  (2.8)  and  define  P»  {P  ■ P'  | A(P)  < 0)  and  Pq  - {P  € P | A(P)  "0}. 

By  Theorem  2.1,  the  set  P is  closed,  bounded  and  convex,  and  there  are  two  elements  P.  and  P* 
in  Pq  such  that  P.<P<P*  for  all  P€P.  Moreover,?  is  the  set  of  all  solutions  P of  (3.30), 
and  Pq  is  the  set  of  all  such  solutions  for  which  B2  ■ 0.  Let  B be  the  set  of  all  solutions 
B - (Bj,B2)  of  (3. 30a) -(3. 30b)  as  P varies  over  P,  and  let  6,  and  §*  be  the  elements  in  B 
corresponding  to  P.  and  P*  respectively.  As  expressed  by  the  following  lemma  (which  is  essentially 
the  same  as  one  found  in  [11])  there  is  a one-one  correspondence  between  P and  P as  well  as 
between  S and  S. 

Lemma  3.3.  The  set  of  matrices  (P,B  1 ,§2)  given  by 

p.p-1  (3.31a) 

(BvB2)-  P”1(B1.B2)  (3.31b) 

is  a solution  of  (3.30)  if  and  only  if  (P,B  y ,B2)  is  a solution  oM1.17).  In  particular,  P,  ■ (P* )~ 1 , 

P*  - (P.)*1.  B.  - (PTV  and  B*  - (P.P^,  . 

Proof.  Pre-  and  postmultiplying  (1.17a)  by  P-1  ard  premultiplying  (1.17b)  by  P~\  it  is  seen 
that  P is  a solution  of  (1.17)  if  and  only  If  (3.31a)  is  a solution  of  (3.30)  with  (Bj,§2)  given  by 
(3.31b).  The  rest  of  the  statement  then  follows  trivially  from  (3.31).  ° 

Lemma  3.3  defines  a bijective  mapping  between  the  sets  B and  S.  This  raises  the  question 
whether  to  each  proper  minimal  stochastic  realization  with  transfer  function  W there  is  a unique 
proper  backward  minimal  stochastic  realization  whose  transfer  function  is  the  dual  spectral  factor 
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W,  and  vice  versa.  In  general  this  is  not  true,  for  a spectral  factor  may  correspond  to  many  proper 
minimal  stochastic  realizations  (Theorem  7.1).  However,  we  shall  see  that  if,  in  addition,  we  require 
that  the  two  realizations  have  the  same  state  space,  i.e.  Ht(x)  - Ht(x),  for  all  t £ R,  there  is  such 
a one-one  correspondence  under  mild  conditions  on  B,  and  that  the  input  processes  are  related  as 
in  Lemma  3.1.  Of  course,  taking  (3.31)  and  (3.1 1)  as  the  starting  point,  the  families  of  forward  and 
backward  proper  minimal  stochastic  realizations  are  seen  to  be  bijectively  related  regardless  of  any 
condition  on  B. 

Theorem  3.4.  Let  (F,G,H,R)  be  defined  as  in  Section  1.  To  each  proper  minimal  stochastic 
realization  of  y of  the  form 


dx  - Fxdt  + Bjdu  + B2<lv 

(3.32a) 

dy  * Hxdt  + R^du  , 

(3.32b) 

with  state  covariance  matrix  P,  there  is  one  and , if  B2  has  linearly  independent  columns,  only 

one  proper  backward  minimal  stochastic  realization  of  the  form 

dx  * — F'xdt  + B^du  + E^dv 

(3.33a) 

dy  * GTcdt  + R^du  , 

(3.33b) 

with  state  covariance  P,  such  that  (3.31)  holds  and  Ht(x)  ■ Ht(x)  for  all  t€  R.  Conversely,  to 
each  realization  (3.33)  there  is  one  and,  if  §2  has  linearly  independent  columns,  only  one  realization 
(3.32)  such  that  (3.31 ) holds  and  Ht(x)  ■ Ht(x)  for  all  t£R.  The  stochastic  processes  in  the  two 

realizations  are  related  in  the  following  way 

x(t)  - P~1x(t) 

(3.34) 

du  * du  - B'jP-1xdt;  0(0)  ■ 0 

(3.35a) 

dv  ■ dv  - Bj^P^xdt;  v(0)  - 0 . 

(3.35b) 

The  relations  (3.31),  (3.34)  and  (3.35)  define  a bijective  mapping  between  the  families  (3.32)  and 
(3.33)  of  forward  and  backward  stochastic  realizations 

Proof.  The  backward  representation  (3.20)  corresponding  to  (3.32a)  is 

dx  ■ — PF'P~^xdt  + Bjdu  + Bjdv  , (3.36a) 

where,  according  to  Theorem  3.2,  u and  v are  given  by  (3.35).  Then  (3.32b)  and  (3.35a)  together 
yield 


dy-  (HP  + R%B’1)P-1xdt+  R%du  . 


which,  in  view  of  (1.17b),  is  the  same  as 


dy  ■ G'P^xdt  + R^du  . 


(3.36b) 


Now  let  x be  defined  by  (3.34).  Then  Ht(x)  - Ht(x)  for  all  t£  R and  IT  has  the  covariance 
matrix  (3.31a).  Moreover,  (3.34)  applied  to  (3.36)  yields  (3.33)  with  B given  by  (3.31b).  Secondly, 
consider  an  arbitrary  proper  backward  minimal  realization 


dJT-  -F'xdt  + B i du  + Bjdv 
dy  ■ G‘x  dt  + R ^du 


(3.37a) 


(3.37b) 


with  B given  by  (3.31b)  and  Ht(x)  ■ Ht(x)  for  all  t € R.  Due  to  the  last  condition,  there  is  a 
nonsingular  matrix  S such  that  x(t)  ■ Sx(t);  since  x and  x are  stationary,  S is  constant.  Set 
T • P~}S.  Then,  in  view  of  (3.34),  x(t)  ■ Tx(t).  Hence  (3.37)  can  be  written 


dx  • — TF'T  ^xdt  4 T&idu  + T§jdv 
dy  ■ G'T~^xdt  + R ^du 


(3.38a) 


(3.38b) 


Since  x and  x have  the  same  covariance  matrix  P,  we  must  have  TPT'  ■ P.  Hence,  in  view  of 
(3.38),  (3.30)  holds  also  with  (P.F'.B.G*)  exchanged  for  (TPT'JF'T-1  jB.GT-1);  in  particular. 
(3.30b)  yields  T(PG'  — BjR'*)  * H*.  which  together  with  the  original  (3.30b)  gives  us  TH'  * H\ 
We  also  have  TF'T-^  ■ F\  To  see  this,  form  E (x(s)  | H*(x)}  for  all  s<t  by  using  first  (3.33) 
and  then  (3.38);  we  get  e ^x(t)  and  e— ^ ^ ^s— ^x(t)  respectively.  Hence 

(F')'H'  » T(F')‘T~^H’  ■ T(F’)'H'  for  i»1,2 n.  and  since  (H,F)  is  observable  we  must 

have  T ■ I.  Therefore  x ■ x.  Then  comparing  (3.33b)  and  (3.37b),  we  see  that  u * u,  and  hence 
(3.33a)  and  (3.37a)  yield  v • v,  for  the  columns  of  B are  linearly  independent.  Hence  (3.33)  and 
(3.37)  are  identical.  Finally,  the  converse  statement  is  obtained  in  the  same  way  starting  out  with 
the  backward  realization  (3.33).  o 


4.  The  minimum-  and  maximum-variance  realizations 

The  proper  stochastic  realizations  corresponding  to  P.  and  P*.  the  minimum  and  maximum 
elements  of  the  set  P,  will  play  an  important  role  in  what  follows  (we  shall  show  below  that  there 
indeed  exist  such  realizations  and  that  they  are  unique).  Therefore  we  shall  begin  by  providing  an 
interpretation  of  these. 

Consider  an  arbitrary  proper  minimal  stochastic  realization  of  the  form  (3.32)  and  with  state 
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covariance  P.  It  is  well-known  [35]  that,  for  each  fixed  T € R,  the  estimate 

x(t;T)-  E{x(t)  I H [T  t)  (dy) } (t>T)  (4.1) 

is  generated  by  the  KalmanBucy  filler 

dx  ■ Fxdt  + K(t  — T)drT  ; x(T ; T)  ■ 0 (T<t<~),  (4.2a) 

where  {»'y(t)  •'  t € (T,<») ) is  the  transient  innovation  process,  defined  by^ 

di^j  ■ R”*(dy  - Hxdt)  ; s‘-|-(max{0,T})  ■ 0 . (4.2b) 

The  matrix  function  K,  called  the  Kalman  Bucy  gain,  can  be  determined  from  the  ma  trix  Riccati 


equation 

Z - FI  + IF*  - KK*  + BB*  ; 1(0)  - P (4.3a) 

K ■ 2H#R~*  + B,  . (4.3b) 

In  the  same  manner,  given  an  arbitrary  proper  backward  minimal  stochastic  realization  of  the 
form  (3.33),  it  car.  be  seen  that 

xb(t,T)  - E{x(t)  IH{tJj(dy))  (t<T)  (4.4) 

is  given  by  the  back  ward  Kalman  Bucy  filter 

dxb - -F'xbdt  + K(T  - t)dr»T  ; xb(T,T)  • ° (~«<t<T),  (4.5a) 

where  {FT(t)  ; t € (— «»,T]  ) . defined  by 

di"^  - R-,/*(dy  - G'xbdt)  ; r>y(min{0,T})  ■ 0 , (4.5b) 


is  the  transient  backward  innovation  process,  introduced  in  [17] . Here  K is  given  by  the  dual 
matrix  Riccati  equation 

f-F'5 +5F-KK'  + BB';  2(0) -P  (4.6a) 

K-lGR-^-B,  . (4.6b) 

Note  that  both  »»y  and  are  normalized  orthogonal  increment  processes  [17] , so  (4.2) 
and  (4.5)  can  be  regarded  as  a pair  of  "nonstationary  stochastic  realizations"  of  y.  We  shall  now 
demonstrate  that  the  steady-state  versions  of  these  representations  are  indeed  proper  stochastic 
realizations  in  the  sense  of  this  paper. 


^Our  choice  of  initial  conditions  in  (4.2b)  and  (4.5b),  which  are  otherwise  arbitrary,  is  to  insure  that 
»>j(0)  ■ 0 (P-p(0)  ■ 0)  for  negative  (positive)  T. 
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Theorem  4.1.  There  is  one  and  only  one  proper  stochastic  realization  (3.32)  with  state  covariance 
matrix  P,  , namely 

H 


dx.  - Fx.dt  + B.du. 


dy  - Hx.dt  + R^du,  , 


(4.7) 


and  it  is  the  steady -state  Kalman-Bucy  filter  in  the  sense  that,  for  each  t € R,  x,(t).  u.(t)  and  B, 
are  the  limits  in  mean  square  of  x(t,T),  Py(t)  and  K(t  — T)  respectively  as  T -*  — «>.  The  innovation 
process  u,  satisfies 


Ht  (du.)  - Ht  (dy)  (4.8) 

for  all  t € R,  and  the  projection  of  the  state  x(t)  of  any  stochastic  realization  (3.32)  onto  H~(dy), 
being  given  by 

E{x(t)|H"(dy)}-x.(t).  (4.9) 

is  invariant  with  respect  to  the  particular  realization. 

Theorem  4.2.  There  is  one  and  only  one  proper  stochastic  realization  (3.32)  with  state  covariance 
P*.  namely 


dx*  - Fx*dt  + B'du* 
dy  ■ Hx*dt  + R^du*  , 


(4.10) 


and  it  is  the  forward  counterpart  (in  the  sense  of  Theorem  3.4 ) of  the  backward  stochastic 
realization 


dx,  * -F'x.dt  + B.du, 
dy  ■ G’x.dt  + R^du. 

where  x,(t),  u.(t)  and  B,  are  the  limits  in  mean  square  of  x^(t;T),  Fj(t)  and  K(T  - t) 
respectively  as  T-*«>.  Then  x*  and  u*  are  given  by 


x*(t)  « P*x.(t)  (4.12) 

du*  - du,  - B'.P'x.dt ; u*(0)  - 0 (4.13) 

and  B,  by  Lemma  3.3.  The  backward  innovation  process  0,  has  the  property 
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for  all  t€R , and 

E(8(t)  |H*(dy)}«x.(t) 

for  the  state  process  x of  any  backward  stochastic  realization  (3.33). 

Before  proving  these  theorems  a few  remarks  are  in  order: 

(i)  It  is  well-known  that 


(4.15) 


E{(x(t)  — x(t; T) ) (x(t)  -x(t;T)]'}  - S(t-T)  , (4.16) 

where  I is  given  by  (4.3);  the  stationarity  of  x insures  that  (4. 16)  depends  on  the  difference 
t-T  only.  Likewise,  set  E {x(t; T)x(t; T)'}  ■ fl(t  - T).  Then 


Kt)-P-n(t)  . (4.17) 

Inserting  (4.17)  into  (4.3)  and  applying  (1.17)  it  is  seen  that  FI  satisfies  (2.6)  and  that 


K-  (G  -nH')R-%  . (4,18) 

Hence  K(t)  •*  B.  as  t-*<»  by  Theorem  2.2.  The  corresponding  dual  results  are  analogous. 
Consequently  one  could  base  the  proofs  of  Theorems  4. 1 and  4.2  on  Theorem  2.2,  but  instead  we 
shall  offer  a self-contained  proof  which  is  more  direct.  Note  that  (4.18)  together  with  (2.6),  and 
its  dual  counterparts,  imply  that  the  filters  (4.2)  and  (4.5)  are  in  fact  invariant  with  respect  to  the 
particular  realization  which  provides  the  process  x (x). 

(ii)  The  choice  of  (3.33)  as  the  standard  form  for  the  backward  stochastic  realizations  rather  than 
(3.36)  is  motivated  by  the  dual  spectral  factorization  problem.  Relation  (4.15)  provides  an  additional 
justification  for  this  choice.  As  in  (4.9),  the  left  member  of  (4.15)  is  invariant  with  respect  to 
variations  in  the  state  process  x.  On  the  other  hand,  were  we  to  project  the  state  process  x of  (3.36) 
onto  the  future  space  H*(dy),  we  would  have 

E { x ( t)  | H*(dy) } - P(PT  V(t)  , (4.19) 

which  does  not  enjoy  the  same  invariance  properties.  Indeed  the  natural  setting  for  the  process  x 
is  the  forward,  and  not  the  backward,  realization  problem. 

Proof  of  Thaoram  4.1.  For  each  fixed  t€R  the  process  {{(r);  r > — t) , where  £(r)  ■ x(t;  — t),  is 
a uniformly  integrable  wide  sense  martingale  (10) , and  therefore  x(t;  T)  tends  to  a limit  x,(t)  in 
mean  square  as  T -*  Moreover, 


%}  j 
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f 


x(t.T)  - E{x(t)  I hjt  tj  (dy) } 

— E{x(t)  I VT<;tH[T  t]  (dy)}  (4.20) 

in  mean  square  ( 10] , and  hence  (4.9)  holds  (a.s.  for  each  t),  for  VT<tH  |T  ^ (dy)  - H~(dy).  Then 

tends  to  a limit  process  u#  . Since  has  normalized  orthogonal  increments,  the  same  must 

hold  for  u,;  hence  u,  is  of  class  W.  In  view  of  (4.20),  FI (t)  and  K(t),  as  given  by  (4.1 7)  and 

(4.18),  tend  to  limits;  let  us  call  these  flo,,  and  respectively.  Consequently,  x,  and  u#  must 

• 

satisfy 

dx.  - Fx.dt  + Koodu. 
dy  * Hx.dt  + R^du,  , 

which  is  a proper  minimal  stochastic  realization  of  y with  state  covariance  Thus  Il^G  P. 

But  since  (4.16)  is  nonnegative  definite  for  all  t 6 R,  (4.17)  implies  that  P>  fl^,  and  this  holds 
for  all  PEP,  for  the  realization  (3.32)  is  arbitrary.  (By  Theorem  7.1  there  is  a proper  stochastic 
realization  for  each  PGP.)  Therefore  [!<„  m P.,  and  consequently  Koe=B..  Given  P#,  the  matrix 
B.  is  uniquely  determined  by  (2.9a).  Moreover,  as  we  shall  see  in  Section  5,  u,  is  uniquely 
determined  as  a causual  function  of  y through  relations  (5.10b)  and  (5.12).  Hence  there  is  only 
one  proper  stochastic  realization  (3.32)  with  P * P.,  and  moreover  (du#)  C (dy).  Since,  in 
addition,  (du#)  D (dy),  (4.8)  holds.  Also,  since  x.  is  uniquely  determined,  the  limit  (4.20) 
is  independent  of  the  choice  of  state  process  x.  o 

Proof  of  Theorem  4.2  The  statements  concerning  (4.1 1),  (4.14)  and  (4.15)  follow  along  the  same 
lines  as  in  the  proof  of  Theorem  4.1,  just  reversing  time.  Then  the  statements  concerning  (4.10), 
(4.12)  and  (4  13)  are  a consequence  of  Theorem  3.4.  o 

5.  Internal  stochastic  realizations 

Consider  an  arbitrary  proper  stochastic  realization  (3.32)  and  its  backward  counterpart  (3.33). 
The  following  lemma  describes  tne  relationship  between  the  two  input  processes  w and  w and  the 
output  process  V 


Lemma  5.1.  Let  Iw.wl  be  the  pair  of  input  processes  defined  above.  Then  the  following  relations 
hold  for  all  t € R 

(i)  H~(dy)  C H~(dwl  and  H*(dy)  C H*(dw) 

(ii)  H(y)  C H(w) 

(iii)  (dw)  C (dw)  and  H*(dw)  C H*(dw) 

l 
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(iv)  H ( w)  * H(w) 

Proof.  Relations  (i)  and  (ii)  are  trivial  consequences  of  (1.1b)  & (1.3)  and  (3.21b)  & (3.22), 
recalling  that  z*z_y.  To  obtain  (iii),  insert  first  (1.3)  and  then  x ■ P“ *x,  as  given  by  (3.22), 
into  (3.1 1).  Then  (iv)  is  proven  by  letting  t -*  00  in  the  first  of  relations  (iii)  and  t -*  — 00  in  the 
second.  □ 

Since  the  input  process  w is  of  class  jl , (i)  implies  that  the  future  increments  of  w are 
orthogonal  to  the  past  increments  of  y,  i.e.  H*(dw)  1 (dy)  for  all  t £ R.  In  the  same  manner 
it  can  be  seen  that  H~(dw)  1 H*(dy)  for  all  t.  It  follows  from  Theorem  5.5  below  that  the 
innovation  process  u.  and  the  backward  innovation  process  u.  are  the  only  input  processes  to 
satisfy  relations  (i)  with  equality,  they  satisfy  (4.8)  and  (4.14)  respectively.  The  only  thing  we  can 
say  about  the  future  space  of  u*  is  that  H*(du*)  C H*(dy),  which  follows  from  Theorem  5.5. 

Hence  we  have  again  detected  a certain  lack  of  symmetry  between  the  minimum-  and  maximum- 
variance  realizations. 

We  shall  now  consider  those  realizations  for  which  the  converse  of  relation  (ii)  holds. 

Definitions.  The  proper  forward  or  backward  stochastic  realization  [A,B,C,D;  wj  of  y is  said  to 
be  internal  if  Hfw)  * H(y).  If  H(w)  =*  H (y) , the  realization  is  said  to  be  ex ternal. 

For  an  internal  stochastic  realization,  the  input  process  w can  be  expressed  in  terms  of  the 
output  y.  Therefore,  if  x is  the  state  process,  x(t)  € H(y)  for  all  t£  (— oc',°°).  In  view  of  Lemma 
5.1  (iv),  the  backward  counterpart  of  any  internal  (forward)  realization  is  also  internal.  Hence,  in 
the  sequel,  we  shall  restrict  our  attention  to  forward  realizations,  and  only  consider  backward  ones 
when  theie  is  an  interplay  between  the  forward  and  backward  settings.  We  now  turn  to  the  character- 
ization of  the  set  of  internal  realizations. 

Theorem  5.2.  -4  proper  stochastic  realization  of  y is  internal  if  and  only  if  it  has  a square  transfer 
function  W .i.e.  W(s)  is  mxm. 

Proof.  The  proof  consists  of  two  parts.  First  we  show  that  H(w)**H(y)  if  and  only  if  W has  a 
left  inverse.  Secondly  we  show  that  W has  a left  inverse  if  and  only  if  it  is  mxm. 

(i)  Assume  that  w(t)  € H(y)  for  all  t £ R.  Then  there  is  a representation 

OC  , 

w(t)  - I — - K(icu)d$M  (5.1) 

—OC  ,u> 

satisfying  the  conditions  of  Lemma  2.3.  Therefore,  since  the  stochastic  spectral  measure  is  unique, 
dw»K(iu>)dy.  But 
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dy  - W(iu))dw  , 


(5.2) 


for  y - 2 satisfies  (1.7b),  and  consequently 

dw  * K(iu>)W(ioo)dw  . (5.3) 

Postmultiply  (5.3)  by  dw*,  take  expectation,  and  note  that  E {dwdw*  } ■ Idu;  to  see  that 

K(s)W(s)  - 1 (5.4) 

by  analytic  continuation.  Hence  W has  a left  inverse.  Conversely,  assume  that  W has  a left 
inverse  K.  Then  (5.3)  holds,  and,  in  view  of  (5.2),  we  have  (5.1).  Hence  w(t)  € H(y)  for  all 
t € R,  and  therefore  H(w)  ■ H(y)  (Lemma  5.1  (ii )). 

(ii)  An  mxk  rational  transfer  matrix  W(s)  has  a left  inverse  if  and  only  if  p(W}*k,  where  p 
stands  for  rank,  defined  with  respect  to  the  field  of  rational  functions  [34;  p.  162,  Theorem  5.5.3] . 
Therefore  it  remains  to  show  that  p (W)  ■ k if  and  only  if  k * m.  To  this  end,  apply  Sylvester's 
inequality  [34;  p.  40]  to  (1.10)  to  obtain 

p {W(s) } + p {W(— s)' } - k < p {4> } < min  [p  (W(s) } , p (W(-s)' } ] , 

which  can  be  written 

2p{W)  -k«£m<p{W}  . (5.5) 

for  p{4*}  ■ m.  Consequently,  if  p{W)  * k,  we  have  k * m.  Conversely,  if  k * m,  (5.5)  implies 
that  p {W } - k.  o 

Corollary  5.3.  A proper  minimal  stochastic  realization  in  the  standard  form  (3.32)  is  internal  if 
and  only  if  82  “ 0. 

Proof.  The  transfer  function  of  (3.32)  is 

W(s)  - H(sl  - Fr1(BvB2)  + (R%,0) . (5.6) 

which  is  square  if  and  only  if  B2  « 0.  d 

Consequently  the  internal  stochastic  realizations  in  standard  form  are  precisely  the  representations 
of  the  type 

dx«Fxdt  + Bdu  (5.7a) 

dy  ■ Hxdt  + R^du  (5.7b) 


I 


I 


among  which  we  have  the  minimum-variance  realization  (4.7)  and  the  maximum-variance  realization  (4.10). 
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Theorem  5.4.  Then  is  a one-one  cornspondence  between  the  family  of  internal  realizations  (5.7) 
and  the  set  Pq  of  solutions  of  the  algebraic  Riccati  equation  A(P)  * 0.  The  input  process  u of 
(5.7)  is  given  by 

7 Jwt  i 

u(t)  - | -VrU\u))dy,  (5.8) 

J IU> 

— oo 

where  W is  the  transfer  function  of  (5.7). 


Proof.  Each  stochastic  realization  (5.7)  has  a state  covariance  matrix  P which  belongs  to  Pq,  since 
82  “0.  (Theorem  2.1).  Hence  it  remains  to  show  that  to  each  PGPq  there  is  one  and  only  one 
proper  stochastic  realization  (5.7)  and  that  u is  given  by  (5.8):  To  each  P € Pq  there  is  one  and 
only  one  spectral  factor  of  the  form  (5.6),  namely  the  square  factor 

W(s)»H(sI-F)-1B  + RV4,  (r  9) 

for  B is  uniquely  determined  by  (2.9a).  Since  R is  nonsingular,  (5.9)  has  an  inverse  W-V  First 
define  u by  (5.8).  Then  dy  ■ W(iu>)du,  which  transformed  to  the  time  domain  yields  (5.7). 
Secondly,  let  u be  the  input  process  of  a proper  stochastic  realization  with  transfer  function  (5.9). 
Then  dy  * W(iu>)du,  and  hence  u is  given  by  (5.8).  □ 

The  internal  realization  (5.7)  can  be  inverted  in  the  time  domain  also  by  rewriting  it  in  the  form 


dx-Txdt  + BR  ^dy 

(5.10a) 

du  - R~^(dy  - Hxdt) 

(5.10b) 

where,  in  view  of  (2.9a), 

r-F  — BR“*H  (5.11) 


is  the  feedback  matrix  (2.3).  Once  there  is  a solution  of  (5.10a),  u is  given  by  (5.10b).  For  the 
two  extreme  realizations,  corresponding  to  P.  and  P*,  such  solutions  are  immediate,  namely 


x,(t)  - J er*(t  T)B.R-*dy(r) 
and 

x*(t )“-/  er'(t_T)B#R-*dy(r) 


(5.12) 


(5.13) 


respectively.  In  fact,  all  eigenvalues  of  T,  (r*)  have  negative  (positive)  real  parts.  (See  Section  2.) 
Then  u.  and  u*  can  be  determined  from  (5.10b). 
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Other  internal  stochastic  realizations  can  now  be  handled  by  integrating  stable  modes  over 
the  past  and  unstable  over  the  future,  provided  that  the  matrix  T has  no  eigenvalues  on  the  imaginary 
axis.  However,  since  P.  < P*  [32,  p.  360] , no  such  eigenvalues  occur  for  Tq  realizations  [33,  p 630; 
Remark  19] . In  fact  the  solution  is  surprisingly  simple. 

Theorem  5.5.  Consider  an  internal  stochastic  realisation  (5.7).  Let  IV*" (FT  ) be  the  projection 
operator  onto  the  invariant  subspace  spanned  by  the  eigenvectors  corresponding  to  eigenvalues  of 
the  feedback  matrix  (5.1 1 ) with  positive  ( negative)  real  parts.  Then 

x(t)-  + n+x*(t).  (5.14) 

where  x,  and  x*  are  given  by  (5.1 2)  and  (5. 1 3).  The  input  process  u is  given  by 

du  - R-,/4ldy  - Hn~x.(t)dt  - Hn+x*(t)dt]  . (5.15) 


The  proof  of  Theorem  5.5  is  based  on  the  following  lemma. 

Lemma  5.6  (J.C.  Willems).  Let  PETQ.andlet  n+  and  n~  be  defined  as  in  Theorem  5.5.  Then 

n+  + n~  - 1 and 

p-  n~p.  + n+p*  . (5.16) 

Moreover,  with  T.  and  T*  defined  as  above, 

irr.rr-  n~r.  and  n+r*n+«  n+r*  . <5.i7) 


In  view  of  the  fact  that  P*  — P.  >0  and  (H,F)  is  observable  (see  Section  1),  this  result 
is  an  immediate  consequence  of  Theorem  6 and  Lemma  8 in  [33] . 


Proof  of  Theorem  5.5.  Let  P be  the  state  covariance  matrix  of  the  stochastic  realization  (5.7). 
Hence  P € Pq  (Corollary  5.3).  Since  (II  )^  * D-  and  n~ n+  * 0,  we  have  I1~P  * n~ P.  from 
(5.16).  Consequently,  in  view  of  (2.9a)  and  (5.1 1), 

n-B-n-B.  (5.18a) 

n~r-n-r.-n-r.n-,  (5.i8b) 


where  in  the  last  relation  we  have  also  used  (5.17).  Hence,  premultiplying  (5.10a)  by  n and 
using  (5.18),  it  is  seen  that  n~ x(t)  satisfies  the  differential  equation 

df-  n~ r.{dt  + n~ B.R-^dy  (5.19) 

on  (-—,«•).  But  n~ x.(t),  too,  satisfies  (5.19)  on  (—»-,«>).  To  see  this,  use  (5.17).  Therefore, 


■ 2~ 
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since  (5.19)  has  a unique  solution  on  (-«•»),  vwe  must  have  n~x(t)  * n~x.(t)  for  all  t € R.  In 
the  same  way  we  show  that  H+x(t)  * n+x*(t).  Hence,  (5.14)  follows  from  IT+  + n-  * I (Lemma  5.6). 
Then  insert  (5.14)  into  (5.10b)  to  obtain  (5.15).  o 

It  follows  from  (5.12)  and  (5.13)  that  x.(t)  € (dy)  and  x*(t)  £ H*(dy)  for  each  t£R. 
Therefore,  (5. 14)  decomposes  x(t)£H(y)  into  two  components,  one  in  H~(dy)  and  one  in  H^(dy). 
In  view  of  (4.8)  and  (4.14),  we  can  acquire  symmetry  between  past  and  future  by  using  (3.34)  to 
rewrite  (5.14)  in  the  form 

x(t)  = n-x.(t)  + n+(p*r1x.(t)  . (5.20) 

Consequently,  the  state  process  of  any  internal  stochastic  realization  can  be  expressed  in  terms  of 
the  steady-state  forward  and  backward  Kalman-Bucy  estimates,  x#  and  x.,  and  therefore  it  can  be 
constructed  from  a linear  combination  of  the  filters  (4.2)  and  (4.5),  by  taking  the  limit  in  quadratic 
mean. 


6.  Families  of  totally  ordered  stochastic  realizations 

Considering  minimal  stochastic  realizations  in  the  standard  form  (3.32)  leaves  only  the  matrix 
B * (B -j ,B2>  and  the  input  process  w=  to  be  determined,  the  parameters  (F,G,H,R)  being 
given.  This  section  will  be  devoted  to  studying  the  set  6 of  feasible  matrices  B,  defined  in  Section  2; 
finding  w will  be  the  topic  of  Section  7. 

It  was  shown  in  Section  4 (Theorem  4.1)  that 


B.  = lim  K(t)  , (6.1) 

t-*oo 

where  K is  the  Kalman-Bucy  gain  function.  This  fact  together  with  the  following  theorem  provide 
us  with  a means  to  determine  B.  directly  without  first  having  to  obtain  P.  . 


Theorem  6.1  (Kailath-Lindquist).  Let  (K,Q)  be  the  unique  solution  on  (0,°°)  of  the  system  of 
matrix  differentia / equations 


K * -QQ'H’R-,/4  ; K(0)  = GR-% 


(6.2a) 


Q - (F  - KR_%H)Q  ; Q(0)  * GR“%  . 


(6.2b) 


Then  K is  the  Kalman-Bucy  gain  function.  The  filter  covariance  function  U , defined  in  Section  4 
(Remark  (i)),  satisfies 


fl  ■ QQ'  ; n(0)  = 0 . 


(6.3) 
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Note  that,  although  different  realizations  (3.32)  yield  different  Riccati  equations  (4.3)  [but 
the  same  filter  (4.2)] , the  non-Riccati algorithm  (6.2)  is  invariant  over  P,  depending  only  on  the 
known  quantities  (F,G,H,R).  If  needed,  P,  can  be  determined  as  the  limit  of  Il(t)  as  t-*’<» 
(Theorem  2.2),  where  n is  generated  by  either  (2.6)  or  (6.3).  The  system  (6.2)— (6.3)  is  precisely 
the  algorithm  derived  in  [17]  by  using  the  transient  backward  innovation  process  (4.5b)  and  in  [16] 
by  factoring  the  matrix  differential  equation  (4.3).  A dual  non-Riccati  algorithm  generating  the 
backward  Kalman-Bucy  gain  K and  the  backward  filter  covariance  II  can  be  derived  analogously 
by  using  the  forward  innovation  (4.2b)  or  alternatively  from  (4.7)  by  applying  the  technique  of  [16] ; 
formally  it  can  be  obtained  by  merely  exchanging  (F,G,H,R)  for  (F',H',G',R)  in  (6.2). 

It  can  be  seen  that  K(t)  approaches  B,  from  outside  of  8.  In  fact,  as  one  can  see  by  comparing 
(2.9a)  and  (4.18),  K(t)  is  related  to  II(t)  as  B,  to  P»,  and,  in  view  of  (6.3),  n is  monotonely 
nondecreasing  starting  out  with  0£Pat  t=0;  hence  II(t)  < P,  for  all  t.  Here  we  shall  show  that 
there  are  equations  similar  to  (6.2)  whose  trajectories,  with  the  proper  initial  conditions,  lie  entirely 
inside  8.  These  equations  will  consequently  generate  families  of  wide  sense  stochastic  realizations. 
Again  the  basic  idea  is  to  eliminate  the  need  of  going  via  the  auxilliary  quantity  P. 

Theorem  6.Z  Let  [F,Bq,H,(R1>/2,0)]  be  an  arbitrary  wide  sense  minimal  stochastic  realization  of 
y in  standard  form,  and  let  8 -*  B(8I  = [Bi^KBjW]  be  the  unique  solution  on  l—00,00)  of  the 
system  of  matrix  differential  equations 

dE$i  ,, 

— - = BoBoH'R-^  (6.4a) 

d 8 * z 

dBo  i/ 

— = = (F-B1R"^)Bo  (6.4b) 

d0 

with  initial  condition  B(0)  = Bq.  For  each  6 E (—00,00),  let  P(&)  be  the  unique  solution  of  the 
Liapunov  equation 

FP  + PF'  + B(0)B(0)'  = O.  (6.5) 

Then,  for  each  6 E (—00,00),  [F,B(0),H,(R^,O)]  is  a wide  sense  minimal  stochastic  realization  of 
y with  state  covariance  matrix  P(0).  This  family  of  realizations  is  totally  ordered  in  the  sense  that 
P(02)<P(0i>  for  0^<e2.  If  B0GB_,B(9)^(B„0)  as  0 -*  °°,  and B0G8+1  B(0)  -♦  (B*,0) 
as  0 ->  — °°.  The  function  0 -*■  P(0)  satisfies  the  differential  equations  (6.7)  and 

|--B2B2,  (6.6) 

and  also  conditions  fiii)  and  fiv)  of  Lemma  6.3  where  here  Pg  may  be  any  point  on  the  trajectory 
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IPU»);  -«-<<)<«>}  . 

The  proof  of  this  theorem  is  based  on  the  following  lemme. 

Lemme6.3.  Let  A be  defined  by  (2.1).  Then,  for  each  Pq€  P,  the  matrix  differential  equation 

^-A(P(0));  P(0)-P0  (6.7) 

d0  u 


has  a unique  solution  on  ( -00,00),  such  that  (i)  P(0)  G P for  all  0 G (— <*0,00),  (H)  P(0j)  ^ P^  \ ) 
for  0^  < 02-  lf  p0  G p_*  p^  “*  p«  as  & f'W  if  Pg  e p+*  “*  p*  **  — ®°- 

Proof.  First  note  that  (6.7)  can  be  replaced  by  the  system 


U(0)A(Pg)U(0)*  ; P(0)-P0 
~-r(0)U(0)  ; U(0>-1, 

dr 


(68.) 

(6.8b) 


where  T(0)  is  the  feedback  matrix  (2.3)  corresponding  to  P(0).  To  see  this,  reformulate  (6.7)  to 
read 

— « (F  - GR_1H)P  + P(F  - GR_1H)'  + PH'R-'W  + GR_1G  , 
d0 

and  use  the  differentiation  technique  employed  by  Kailath  in  [15) , i.e.  observe  that 

2 

^ ■£ + S r((,)'  •*  ^ ■ A<po>  * 

dr  dr  dr 

and  integrate  to  obtain  (6.8). 

Clearly  the  Riccati  equation  (6.7)  has  a unique  solution  locally  in  the  neighborhood  of  0-0. 
In  fact,  at  least  for  small  0,  P(0)  - Y(0)X(0)~V  where  the  nxn-matrix  valued  functions  X and 
Y satisfy  a linear  system  of  differential  equations  such  that  X(0)“^  exists  for  sufficiently 
small  0 [8,  p.  156) . Since  Pg  G P,  A(Pg)  < 0,  and  hence,  in  view  of  (6.8a),  the  condition 

^<0  (6.9) 

d0 

holds  along  this  trajectory.  Consequently,  (6.7)  implies  A(P(0))  < 0,  i.e.  the  trajectory  is  contained 
in  the  bounded  (Theorem  2.1)  set  P.  Hence  the  solution  can  be  extended  to  the  whole  real  line, 
for  P(0)  will  never  leave  P.  Since  A is  locally  Lipschitz,  this  solution  is  unique.  This  also  proves 
(I),  and  (ii)  is  a consequence  of  (6.9). 

To  prove  (iv)  we  use  an  argument  similar  to  that  in  Willems  [33,  p.  631) . In  view  of  the  fact 
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that  A(PJ<0,  S(0) P(0)  - P,  is  the  solution  of 

r.s  + sr.  +sh'r_1hs  ; s(0>«p0-p.  . 

d0 

Since  S(0)>0  (for  P0€  PJ  and  ^§<0  (by  (6.9»,  S(0)  > 0 for  0<O.  Consequently  S-1 

* da 

exists  on  (—‘*,01 . Let  M,  be  defined  as  in  Theorem  2.2,  and  define  V : • S~ 1 - M.(0).  It  is 
easy  to  see  that  V satisfies 

5jY._r.v-vr. 

on  (-«,0).  Since  Re{X(-r.)}  >0,  VUM-0  as  0 -•• -«,  and  hence  S(0)  - (M.(0)] -1  - P*  - P. 
(Theorem  2.2).  Therefore  P(0) -+ P*  as  (>-►—«>.  This  proves  (iv).  The  proof  of  (iii)  is  analogous; 
just  exchange  substar  (.)  by  superstar  (*)  everywhere  and  (— o°,0]  for  [0»).  (Now  S(0)  < 0 for 

e>  0.)  a 

Hence,  given  any  Pq  in  P+  n P_,  we  may  construct  a trajectory  TCP  extending  from  P* 
through  Pq  to  P.  so  that  T is  a totally  ordered  set  of  matrices  P satisfying  (1.17).  The  only 
difference  between  (2.6)  and  (6.7)  is  the  initial  conditions  (0  € P);  the  differential  equation  is  the 
same.  Its  critical  points  are  precisely  the  elements  of  Pq,  one  of  which  (P.)  is  locally  stable  in  the 
forward  direction  and  another  of  which  (P#)  is  stable  in  the  backward  direction  (cf  [33] ).  Note, 
however,  that  (6.2)  and  (6.4)  are  not  exactly  the  same,  although  they  are  derived  from  the  same 
differential  equation.  A dual  (backward)  version  of  (6.1)  can  be  obtained  by  factoring  (2.7),  with 
H(0)  € P,  as  above. 

Proof  of  Theorem  6.2.  Let  Pq  be  the  state  covariance  of  the  initial  realization  [F,Bq,H,(Rv’,0)1  , 
and  let  (P(0);  -®°  < 6 < 00 } be  the  trajectory  through  Pq  defined  by  Lemma  6.3.  Define  BUM  as 

B^fl)-  [G  - P(fl)H')  R"%  (6.10a) 

B2«M  - U(0KBq)2  , (6.10b) 

where  U is  given  by  (6.8b).  Then  (6.6)  and  (6.4a)  follow  from  (6.8a)  (for  A(Pq)  * — (Bq)2(Bq)'2) 
and  (6.4b)  it  a consequence  of  (6.8b)  and  (6.10).  A local  Lipschitz  condition  insures  uniqueness. 

In  view  of  (6.6)  and  (6.7),  we  have  B2(0)B2(0)'  - -A(P«M),  which  together  with  (6.10a)  yields 
(6.6).  Since  Re{X(F))<0  and  (F,B(0))  is  controllable  (for  (F,Bq)  is),  (6.5)  has  a unique  positive 
definite,  symmetric  solution  (8) . This  fact  together  with  (6.5)  and  (6.10a)  insures  that  (P(fl),B(fl)) 
satisfies  (1.17),  and  consequently  (F,B(0),H,(R^,O))  is  a wide  sense  stochastic  realization  with 
state  covariance  P(0).  By  Lemma  6.2,  P(0)  satisfies  conditions  (ii)-(iv),  and  obviously  the  last  two 
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conditions  hold  for  any  Pq  on  the  trajectory  (P(0);  — «»<  0 < «»}.  Finally,  the  fact  that  Bj(0) 

tends  to  B,  (B*>  « 9-*«  (0  -*  -«>)  under  the  stated  conditions,  follows  from  conditions  (iii) 

and  (iv)  and  (6.10a).  Since  — 0,  (6.6)  implies  that  B2(0)  -*  0 as  0 -*  ±«®.  ° 

d 0 * 

In  the  next  section  we  shall  interpret  Theorem  6.2  in  terms  of  proper  stochastic  realizations. 


7.  External  stochastic  realizations 

The  following  theorem  gives  a complete  characterization  of  all  proper  minimal  stochastic 
realizations. 

Theorem  7.1.  Let 


dx  » Fxdt  + B^du  + B2dv  (7.1a) 

dy  ■ Hxdt  + R^du  (7.1b) 

be  a proper  minimal  stochastic  reel izetion  of  y,  and  let  W^(s)  and  W2(s)  be  defined  by 

W1(s)-H(sl-Fr1B1  + R%  (7.2a) 

W2(s)«  H(sl-  F)-,B2  . (7.2b) 

Then 

W(s)  ■ (W^sl.Wjfs))  (7.3) 


is  a minimal  stable  spectral  factor  of  the  spectral  density  4>  of  y,  and  the  input  processes  are 
given  by 


, 7 iwt  . . 

W^(— iu>)'4»-MMdy(w)  - J -W-,  MMW^iwJdzM 

—06 


(7.4b) 


W2(-iu))'4‘”1(iw)dy(w)  + z(t) 


(7.4a) 


where  z is  a mean-square  continuous,  purely  nondetarministic  stochastic  vector  process  with 
stationary  increments,  zero  mean,  spectral  density 

♦ (s)  • I - W2(-s)'4>”^(s)W2(s)  , (7.5) 

and  z(0)  ■ 0.  Moreover,  4»(iu))  > 0 for  ell  reel  u>  end  H(z)iH(y );  we  shall  call  z the  exogeneous 
input  component.  Conversely,  for  each  minimal  stable  spectral  factor  (7.3)  of  <t>,  there  is  a 


minimal  proper  stochastic  realization  {7 A)  with  u and  v given  by  {7 A),  i being  an  arbitrary 
stochastic  vector  process  with  all  the  properties  prescribed  above. 
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Proof.  It  was  shown  in  Section  1 that,  with  (7.1)  given,  (7.3)  is  a minimal  stable  spectral  factor  of 
this  result  is  restated  here  for  completeness  only.  To  see  that  u and  v are  given  by  (7.4),  first 
decompose  v as 

v(t)  ■ E{v(t)  I H(y)}  + z(t)  . (7  6) 


Then  H(z)  1 H(y).  Given  the  properties  of  v and  y described  in  Section  1,  it  is  easy  to  see  that 
the  first  term  in  this  decomposition  is  a mean-square  continuous,  purely  nondeterministic  vector 
process  with  stationary  increments,  so  the  same  must  hold  for  z;  in  addition,  z has  zero  mean  and 
z(0)  » 0.  Hence,  since 


dy(cu)  * W.(icu)du,(tu)  , (7.7) 

where  du#  is  the  stochastic  spectral  measure  of  the  innovation  process  u,  and  W,  is  the  transfer 
function  of  (4.7),  and  in  view  of  Lemma  2.3,  (7.6)  can  be  written 


OO 

Z(iu>)dU'(cu)  + j 

OO 


icut 

e 


— dz(u>)  , 


i to 


(7.8) 


for  some  Z to  be  determined.  Let  denote  the  spectral  density  of  the  process  z.  Clearly  there 
is  a representation 


dz(u>)  • T(iu>)d/i<u>)  , 


(7.9) 


where  dp  is  the  stochastic  spectral  measure  of  a process  p of  class  U>  such  that  H(p)  1 H(y), 
and  T(s)  is  a spectral  factor  of  >Hs).  Then  (7.8)  can  be  written 

dv  » Z(iu>)du,  + T(iu>)dp  . (7.10a) 

Therefore,  inserting  (7.7)  and  (7.10a)  into 

dy  * W^(iu>)du  + V^iooldv  , (7.11) 

which  is  (7.1)  rewritten  in  terms  of  spectral  measures,  and  solving  for  du,  we  obtain 


where 


and 


dG  ■ X(iu>)du,  ♦ Y(icu)T(iu>)d£  , 
X(s)  - Wf^^WJs)  - Wf^OWjJsJZU) 

Y(»)--Wf1(a)W2W  . 


(7.10b) 

(7.12) 


(7.13a) 
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for  the  matrix  R being  nonsinyular  insures  that  has  an  inverse.  Since  both  ^ 
vector  processes  of  class  W,  the  coefficient  matrix  function  of  (7.10),  i.e. 


,nd  M 


are 


_X(s) 

Y(s)T(s)  " 

[ s 

K(s)  ■ 

2(s) 

T(s) 

(7.14a) 

(7.14b) 

(7.14c) 


(7.13b) 


satisfies  relation  (2.13)  of  Lemma  2.3,  i.e. 

X(s)X(— s)’  + Y(s)T(s)T(— s)'Y(— *)’  - I 
X(s)2(— s)'  + Y(s)T(s)T(— s)'  - 0 
2(s)2(— s)'  + T(s)T(— s)'  ■ 1 . 

Then  inserting  (7.12)  into  (7.14b)  and  applying  (7.14c),  we  have 

2(s)-W2(-s)'Wr1(-»)'  . 

which  inserted  into  (7.12)  yields 

X(s)«  W1(-s)*W71(-s)'  . 

To  obtain  this,  we  have  used  the  fact  that 

4>(s)»  W1(s)W1(-s),  + W2(s)W2(-s)'  . 

Now  (7.10)  together  with  (7.7)  and  (7.13)  yield  (7.4),  and  (7.13b)  and  (7.14c)  give  us  (7.5),  for 
T(s)T(-s)'  ■ vKs).  By  using  the  matrix  inversion  lemma  (14,  p.  124] , we  can  see  that 

*(s)- (1  + W2(— s)'Wf1(-s)Wi  1(s)W2(s))-1  . (7.16) 

Hence  'Hiu))>0  for  all  real  to. 

Secondly,  assume  that  a minimal  stable  spectral  factor  (7.3)  is  given;  from  it  we  can  determine 
a quadruplet  (F,(B^,B2),H,(R^,0)] . Let  z be  an  arbitrary  mean-square  continuous  process  with 


(7.13c) 


(7.15) 


stationary  increments,  zero  mean,  and  spectral  density  (7.5),  and  such  that  z(0)  * 0 and  H(z)  1 H(y). 
Since  z has  a rational  spectral  density,  it  is  purely  nondeterm  in  istic  [9] . Define  u and  v by 
(7.4).  Then  the  corresponding  stochastic  spectral  measures  dC  and  dv  are  given  by  (7.10)  with 
X,Y,2  and  T defined  by  (7.13)  and  (7.9).  Straight-forward  calculations  using  (7.15)  show  that 
X,Y,2  and  T satisfy  (7.14),  and  consequently  is  a process  of  class  W.  Finally,  with  the  help  of 
(7.15),  we  can  see  that  du  and  dC  thus  defined  satisfy  (7.11)  (the  z-components  cancel),  and 
therefore  (7.1 ) is  a proper  stochastic  realization  of  y.  □ 


F 
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Theorem  7.1  provides  us  with  an  alternative  proof  of  the  "only  if"  part  of  Corollary  5.3. 
(Theorem  5.5  gives  an  alternative  proof  of  the  "if"  part.)  In  fact,  since  4'(iw)>0  for  all  real  u>, 
the  exogeneous  input  component  z is  never  identically  zero.  Therefore,  unless  B2  - 0,  the  output 
of  (7.1)  contains  a component  orthogonal  to  H(y). 

We  are  now  in  a position  to  interpret  Theorem  6.2  in  terms  of  proper  minimal  stochastic 
realizations.  Consider  an  arbitrary  such  realization 


dx  - Fxdt  + (Bg^dug  + (Bg)2dvg 
dy  ■ Hxdt  + R^dug 


(7.17) 


with  exogeneous  input  component  zg  having  spectral  density  ♦g(s).  Let  Tg(s)  be  a square 
spectral  factor  of  'J'g(s)  and  define 


r Jwt_i  i 

#*(t)-J  Tg-MiwJdzgM  . 


(7.18) 


(Since  'l,Q(ia>)>0  for  all  u>,  Tq(s)  has  an  inverse.)  Then,  n E U/^,  where  k is  the  number  of 
columns  of  (Bg)2.  Let  F be  the  sigma-algebra  generated  by  (y(t),  p(t);  t€  R } and  form  the 
probability  space  (£i,F,P)  on  which  (7.17)  is  defined.  Then  (7.17)  gives  rise  to  a family  of  proper 
minimal  stochastic  realizations 


dxfl  - Fxgdt  + Bj(0)dug  + B2(0)dvg 
dy  * Hxgdt  + R^dug  , 


(7.19) 


which  are  defined  on  the  same  probability  space  (ft,F,P)  and  which  are  totally  ordered  in  the 
sense  that  the  state  covariance  function  P(0)  ■ E {xg(t)xg(t)' } is  monotonely  nonincreasing  in  6. 

In  fact,  for  each  0 € (—00,00]  ( define  W.j(s;0)  and  W2(s;  0)  by  inserting  (B^fl),  B2(0)) , generated 
by  (6.4),  into  (7.2),  and  let 


00  , 

/JoJt, 

— — — Tg(iw)dpM  , 


where  Tg(s)  is  a square  spectral  factor  of 


*e(s)  - I - W2(-s;0)'$-1(s)W2(s;O)  . 


(7.20) 


(7.21) 


(We  may  for  example  take  all  Tg  to  be  minimum  phase.)  Then  define  ug  and  vg  by  inserting 
W^s.  ^),  W2(s;0)  and  Zg  into  (7.4).  Hence  xg(t),  ug(t)  and  vg(t)  belong  to  H(y,  n)  for  all  t 
and  all  0.  If  Bg€  8_,  the  family  (7.19)  will  contain  the  steady-state  Kalman-Bucy  filter  (4.7);  if 
Bg€  B+,  it  will  contain  the  maximum -variance  model  (4.10).  Finally,  if  Bg€  Bg,  (7.19)  will  only 
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contain  one  realization,  (7.17)  itself. 
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